A Multimodal Mobile B2B Dialogue Interface on the iPhone
نویسندگان
چکیده
In this paper, we describe a mobile Business-to-Business (B2B) interaction system. The mobile device supports users in accessing a service platform. A multimodal dialogue system allows a business expert to intuitively search and browse for services in a real-world production pipeline. We implemented a distributed client-server dialogue application for natural language speech input and speech output generation. On the mobile device, we implemented a multimodal client application which comprises of a GUI for touch gestures and a three-dimensional visualization. The client is linked to an ontology-based dialogue platform and fully leverages the device’s interaction capabilities in order to provide intuitive access to the service platform while on the go.
منابع مشابه
A Multimodal Multi-device Discourse and Dialogue Infrastructure for Collaborative Decision-Making in Medicine
The dialogue components we developed provide the infrastructure of the disseminated industrial prototype Radspeech—a semantic speech dialogue system for radiologists. The major contribution of this paper is the description of a new speech-based interaction scenario of Radspeech where two radiologists use two independent but related mobile speech devices (iPad and iPhone), and collaborate via a ...
متن کاملMobile Multimodal Dialogue Systems
Mobile multimodal dialogue systems allow the user and the system to adapt their choice of input and output modality according to various technical and cognitive resource limitations and the task at hand. We present the multimodal dialogue system SmartKom, that can be used as mobile travel companion for car drivers and pedestrians. SmartKom combines speech, gestures, and facial expressions for i...
متن کاملA Constraint-Based Graph Visualisation Architecture for Mobile Semantic Web Interfaces
Multimodal and dialogue-based mobile interfaces to the Semantic Web offer access to complex knowledge and information structures. We explore more fine-grained co-ordination of multimodal presentations in mobile environments by graph visualisations and navigation in ontological RDF result structures and multimedia archives. Semantic Navigation employs integrated ontology structures and leverages...
متن کاملREST-based Meta Web Services in Mobile Application Frameworks
This paper describes how a multimodal dialogue application framework can be used to implement specific mobile applications and dynamic HTTP-based REST services. REST services are already publicly available and provide useful location-based information for the user on the go. We use a distributed, ontology-based dialogue system architecture where every major component can be run on a different h...
متن کاملImiracle: Multimodal Speech-enabled Mobile Video Search
This paper describes iMIRACLE, a system designed to support multimodal speech-enabled mobile video search of previously recorded broadcast TV programs. It allows the user to search for video content using an interface combining spoken and graphical interaction. Users can search for video based both on metadata and the content itself. The principal technologies used include large vocabulary spee...
متن کامل